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t. ABSTRACT 

Supervisory control systems must deal with various types of hmeSgence' 1 distributed twoughout the layers of 
control Typical layers are realtime servo control, off line planning and reasoning subsystems and finafly, the human 
operator. Design methodologies must account for the fact that the majority of the intefigence wH reside with the human 
operator. This pgrterforeffmopjhietaichica feedback loops as conceptual boating blocks that provide a 

common ground for man-mactthe fcteractfon^Kamptes of types of parafetism and parallel implementation on several 
f comp u ter architectore are ateo dfecussetfcv /, 
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2HHfROOUCnON 


Designing systems that involve a V>t of interaction with humans is a cSfficutt task. Although humans are intefigent 
foey are also unpredfctabfe. ft is easier to conceive of completely 'autonomous* systems, requiring little man-machine 
interaction. But with such systems human operators run the risk of losing control and at some point the operator may 
want to redked assist, troubleshpot or enhance the system. Thus, it is desirable to be operating somewhere in the 
middte ground, where systems am designed to be autonomous only in the sense that they are part of a larger system that 
provides a means of imeractfon *wh humans. The concept of "supervisory control" provides such a framework. 

2.1 General System DesJpi Goal 

Put in simple termsTrt is desirable to have systems that are refiable. flextole and exportable (Figure 1). Refiabifity 
implies that the system /arely fails and that there is a quick fix for faflures such as plugging in a new readly available 
module. Along with pqor testing and evaluation is the development of run-time aids such as fault detection, isolation and 
ctiagnosts systems, ay of which improve retiability. A flexible system is one that can perform many different functions or 
tasks and can operay in cfiverse environments. Such a system must consider many alternatives and be able to “understand - 
its environment After a system is fielded it is invariably discovered that new capabilities are desired or required. An 
ex p a n da ble system /can easily incorporate new functions and more knowledge. 
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Figure 1. Design concepts 
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Many of these design goals boi down to provkfing fw system with "Emergen ce *. Although twe has been much 
progress in the development of systems that deplay Imited forms of totetegencM « often the casa fiat urtien inteBgance 
is required human operators must be i ncorporated. Therefore, toe development of complex systems now and in tie near 
future wfl rely heavily on human operators (Figure 2). 




Figure 2. A definition of ** supervisory control" 


2.2 Supervisory Control 

To effectively operate a system, a hunan must focus attention and can only expend a certain amount of energy. The 
more autonomous toe system, the less attention required from the human operator. If the goal is to have less and less tor 
the human operator to do the human would ultimately become a " w atchm a n* aslee p until an alarm sounds. Unfort u nately, 
human expertise should be used more efficiently. Thus, the proper dfcection to move in is that as a 
particular system becomes "smarter*, the operator devotes less attention to ft and devotes increasingly more attention to 
a second system, and so on. From this perspective, the operator has various, possfcfy autonomous, subsystems under his 
coned as he orchestrates the performance of the overal system. 


2.3 Amplifiers of Human Capabilities 

Machines, in general, enhance human capabOties. Machines give stength. reach and dexterity not normatiy 
possessed by humans; they can protect presence into areas that would not normatiy be entered; they allow detection of 
things that are beyond the capabity of human senses and foey can enhance our analytical atofity by rapktiy analyzing data 
and summarizing the results (Figure 3). In this sense machines act as •amplifiers’' of our capacities, inducting the 
amptification of our intelligence. From this point of view, the design of a complex system is seen in terms of a cantrafly 
placed human operator - the soiree of in te teg o n co - supported by a dvanced man-machine rntartaces teat provide an array 
of "tools*. The tools are not intended to replace man. but to make it easier tor him to perform dftficult tasks. 
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Figure 3. The oysters acts as an "anpl if ier" of hunan capabilities 


3. LEVELS AND LOOPS 

In seeking a common ground for both man and machine, two design techniques stand out hierarchical decompositions 
ano feedback loops (Figure 4). Although these two concepts are not mutuafy exclusive, they have contrasting properties, 
emphasizing different aspects of the system under scrutiny. Just about every system has elements of both. In tact the 
same system might be described in terms of a hierarchy or a particular feedback loop, depending on the emphasis desired. 
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First we w* discuss hierarchies. 



Figure 4. System design oethodologies-levels and loops 

3.1 Hierarchies 

Hierarchies are pervasive, appearing in societal structures such as tie mStary, corporations, churches, and in 
more absfract areas such as general problem solving (Figure 5). Some of toe simplest hierarchies appear in knowledge 
representation, resulting from natural taxonomies such as "part-of". Is a" or "kind-or. Similarly, spatial 
decompositions such as topogr a phical maps or geometric descriptions of a robot environment treated at various levels of 
resolution provide examples of hierarchical decomposition. Approaches to complex problems such as speech and image 
understanding invariably involve levels, with the lowest ones associated with “primitives', the mkfctfe ones with various 
patterns and the highest ones wito symbolic int e rpretations. In [1], the organization of functions in a robotic environment 
such as an automated factory is described as a hierarchy, with high levels related to planning and reasorxng about the task 
and low levels identified with servo control. 



Figure 5. Examples of hierarchies 


After looking at several hierarchies some general properties emerge. In more complicated scenarios, such as the 
decompostion of tasks for a robot, the highest levels are associated with reasoning and planning typcafy using very 
general global or abstract knowledge. As a result the highest levels tend to ieiy on thoughtful, slow, symboic processing 
(Figure 6). The overal goals of the system are set at toe highest levels, typically considering many alternatives, 
representing toe "goal-driver:' aspects of the system. In contrast, toe lowest levels are associated with 'action', using 
specific local knowledge. At toe lowest levels are numeric, algootomic processing that results in fast reflex action 
representing the "data-driven" aspects of the system. The overal hierarchy usuaty f* presents a decomposition of 
tactions toat is equivalent to toe successive reduction of a problem into smaler and easier subproblems. 

The dynamics in a hierarchy become a pp ar ent when it is resized toat information can flow in either direction, 
creating loops toat can s trade** several levels (Rgure 7). Furthermore, each level must be able to communicate with 
levels above and below, poss&y requiring separate, local, languages, and also possbiy swamping the middte levels with too 
many messages. 


A hierarchical approach is not ateays easy to apply. For complex systems, defining the appropriate levels is quite 

141 


















c»np fc^ fiwiing^ao^na^samedWta^Modated^ o »>^pro b >«m»o^ «ndfcn o^dg>i» praa <nafa n . 

7I» probten reduction inharant In ■» NaranNcal deewnpcsilton cm ta> alwrt bacauw ol comptai ittanalaltont among 
ttbpnMn. N ava rlh al aw . a hfen reWca l approach % axtramefr powartU in is atoMy lo fluid* fia dasign o< » compto 



• Th* iMh Ait Eacy T« (Mm far T* 


• For Cw a plw S iMM tinwt . IN Art Up Apart 


If Latafc Aio Mat Do* — ■» -, .. <tM— ^lurtwidit 

Figure 8. The challenge of hierarchies 


Whit toe use of hier a r ch ie s refleas the need to decompose large systems into smafler tactable subsystems, 
feedback reflects the need to account lor uncertainty. » a human operator or an autonomous systom had perfect knowledge 
toere work) be no rued for feedback since flings woUtiafcvays go acoordtog to plan. Unfortunately, knowledge is often 
i nc omp le te and erroneous andasaresuil actons must be Mowed by some form of checking. 

The basic process underlying a feedback loop consists of two steps, repeated unfli euccessM : 1) using feedback, 
eHher trom sensors or otoer sources ol intocmatfon, compare current state wflh desirad stale; 2) based on the rasufts ci 
f* first step, decide on an action toatwte move the system closer to toe desired stats. Figure 9 depicts several types of 
toeaoacxpops. 



• Fwdtect HaKn Accmm for UwntiiMv 


• Tht EmpMM K om iNotMtnM Aay w T w mmd a Goal 

Figure 9. Feedback loops 


The test step assumss that sutecfent infor ma tion can be gathsred fcom toe particular domain of interest ( ie. NvortcT) 
and represented in a form that can be compared unto some representafion ol toe goal For example, a simple sera 
confol loop machea a desired with a measured faiectory to creete an error signal ter toe 'coneofler' which attempts 
to drive toe error to zero by the proper actuation. In tots way a rtfeflve* simple modal of toe NvorkT can be very 
effectors. By focusing on toe crifical i nf or ma tio n as represented by toe error signal, a rapid response can be easfly 
formulated: but robust behavior (such as a dapt a tio n to toad changes, coftsfen a wadance and compflantconeol) is dMcufi 
to achieve without detaflad dyrvavnic modsfs. That is, in most cases toa ostision on what to do at aach iteration is not 
obvious. Altoough toe iterative rmiae of f» feedback loop impies incremental or local progress toward toe goal. global 
knowtodgt must be used as wel to nod dead ends and local externa. 

Anotoer basic example fetoelmeans^rids'anteysfeusedasaproblamsokfingperackgm. Here, toe r e pre s entati ons 
of stales, goals and available operators can be quftt absfact bu toa approach can be described in terms ol sloop. A 
comparison of toe current with the desired stole detects a dWerence fiat is used to select oper a tor s that can reduce toe 
deference. Typically, this produces a search process as various operators are toed out on a simulated •raricT. Once 
again, though, one of the major dffcuftes in applying such a procedure is the need to reoognae global contamts at toe 
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Figure 10. Typical task 




Figure 11. Search 


4.1 Search 

Unless tie environment m extremely con st rained. ee ar chtoQ tor an object wii rely pnmarifr on vwi ( a* posstoly 
range image* ). This sensory data must bs processed end co mpared with inland m od e* of tie objects physical 
properties. taction* aspects and expected location. In gener*. tm is known to be a very cfiflcut task, involving 
hierarchical sauctures tftat attempt to organize knowledg e chwen processes arteng torn e xp ectations. and tie data 
driven processes vising tan tie reduction of sensory data into image primitives such as sdgaa. Ines and surfaces. 
Searching lor objects wto revere a significant amount of he*> torn tm human supervisor. 


Navigation entafe tie interplay of an interesting combination of information :l) pnor knowledge ol toe environment 
typacatiy desafeed in global terms since tie delate would be had to keep track ol ( tor example, a des cri ptio n of tie 
stucturef componen t su^ias tie main passa g e w ays and knoem beacons could be av a tiatl a. bit smatiofaeadaseoidd have 
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tobodtocovered):?) The robot* sensors such as vision and prorimiy would have to provkto toe local biloimaion about 
toe envkonmsr* and useitoavold obstacles an d t aoognizaqnrtaarfcs; 3) Mam* moion sensing coukl be used to gjw toe 
robot an asHmsSs of to position independent of too stomal sensors; 4) Italy. planning paths tost nogototo best 


la onto to suc cassMy navigate. N robot must use s» 
spots and dead ends vtols taasoning about progress 
ia a vary sametursd environment. but in raal 


m niDniHBQn, 

too goal. 

toe problem is quite 


inquiring tool 



p lxure 13. Manipulate 


43 Manlpuiata 

H me robot is success** in gating to toe object (Figuro 13). it must, among other Mngs: d a tarmlna vtostoar 
neighboring objects must be moved to get at it. inspect toe objact to see 1 1 q dataettva. detect toe mad lor spatial 
propping tools. And grasp points, and essmate toe weight and teengto of toe object Altar graspmg toe object aanaoro 
must monitor ovorol stabity a n d detect si ppaga a nd overload. Once toe object it sears* in toe robot* grasp, toe robot 
must navigate to toe goal as a dtoerent dynamic system etoicb may ator toe chosen routs. The majority ol Usee 
subtasks a* require toe intervenion ol a human operator. 

4.4 Complexity 

Even a cursory view of toe go-Mch example iml carot Hat toere to a tremendous co mpto xi ty involved. Upon 
analysis, toe vaious subtasks are interrsl alert, and toe idenMcalon of various sauctoroe such as hierarchies and 
feedback loops can only have Med eaeet since even toey are tangled among each otosr. O eani ng •primtove' tasks, euch 
as peg-in-hoie and tom-crank, q an exce i en t way to control toe comptoaqr. AMtough toto approach a somewhat baaed 
by toe dtocisle primitives and combinatorial erotoatoq. > r epr ese n ts a sold hierarchical approach tout can buM up 
complex tasks bom easiy understood prMfees ( see P) tor an roamplo of Ms approach ). 

R q not uncommon lor a robotics engineer to graduaiy resize toat what at tost appeared to bo easy to autosMte q 
extsmeiy complex, defying ai attempts at auto m ation. The history of vamn and natoral language research provide 
classic examples, but toq phenomenon nms toroughout toe rotates world. 

Humans have an uncanny abiity to sknpMy toings. The environment presents an exsemeiy complex array of 
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Figure 15. Complexity 


4. PARALLELISM M SUPERVGORY CONTROL SYSTEMS 

ResHirra execution fdbtftoutodsupervtoory control sysromswfisqfw imptomenl f ion on piraflf and advanced 
computer arch ite ctu res. This requirement is driven by the types of processing and processing requirements in 
supervisory control systems. As • the case with iroderstanfng and descri bin g a problem, it is useful here to tank in 
twins of levels or hier ar chie s . Since toe types of pro c e ssi ng in a tu psnsao r y co n sol s y st e m are so diverse, iritonafte 
imptemen ia lton wa require a network of spoof purpose, pa ra Sa l , and serial a r ch ite ct ur es . In toe remainder of tois 
taction we briefly consider toe types of proc es sing to a supervisory control system and toe suitabiCty of various 
archSffctjros to these levels. Furthermore, we suggest that the b igge st p roblem teeing per s is t impiementfion of 
supervisory control systems is lack of mature software tools end techniques lor implsmsntotio n of these sysitms on 
dfributod and p a r a ll el ar ch flec lu ro s . 

5.1 Processing Requireme n t s 

The processing requirement of a s^ervtoory control system can be roughly dfcidsd into twee levels which suggest 
toe types of arontoctures which are beneficifL These levels are not neceesarfly musiafly exclusive as tasks may occur 
which straddle several levels. 


5.1.1 Low Level Proc essi ng 

This level is is connected wito infraction wito toe environment through sensors and commends to effectors and 
actuators. Typicf tasks performed M tod Isvf are: sensor dwVocosstogffitohng such as aega feature emetion 
(convolutions), associalive retoevf. and simple trajectory generation. Thto levf to genecafly characterized by toe 
toiowing requirements: 1) High ba ndwid to VO rases; 2) Numeric pro c e ssi n g ; 3) Algorithmi c processing ratoer than 
search among atematos; 4) IdenflcaL repealed operators on bounded regutar data stuctures. 


Specif purpose hardware is often appfied to much of toe processing f tois toroL The spsdf purpose hardware can 
be serial or parafleL but typicafly is designed tor very specific functions such as comcWons and does not support ganerf 

146 


$•40 processors |4J •*• perticufariy wefl suited to toto lavel of processing. Examples of Ms class of paraM 
proceaaor are toe Mac IV and MPPpj. These machines are particutariy weti suiad tor problems involving identical 
operation s on bounded tegular data structures each as matrix mutifpticatiort. peraM sorting. and fast louder tanstom*. 

MU) processors HI such as Vie B8N Butterfly and Cm* have atoo been appled to toese types of problems, however, 
toey have not achieved toe same level of p erformanc e as SIMP ma chine s p^. 

Hi MM Level Processing 

I me mm concerns more general purpose procesiisiQ man emier me lower or rearer eves, in* wvo gmevf 
perform s operations on M M re d, preproce ss ed sensory data fcom tie tower JeveL Typical fcnctions performed hern are 
vuiysis {oopKX Sfnpw wnio® rh™ wo 0 (XnttNon pfooiMis usng wcnw^iw woi 

aady na m fc p rogramming. This level is characterized by toe Mowing requiremente: 1) Medfcm bandwfcfth (Orates; 2) 
Varied operetion e on regular or irregular data structures co n t ai ning simiar data types; 3) Optimized choice among a 
bounded aatot alternatives. 

SttP ma chines can be effe cti v e ly apptied to this level ol p roces si ng ti toedtea lo be oper a ted on can beaffocated 
untiormly across tie processing dem ents and tot processing performed on toe data el em e n ts is simiar. In the absence of 
toese. many of the eie m ents in me processing array re mai n kfle bo much of tie time resulting in inefficient use of the 
system. In such cases. HMD processor can be appled. 

The MfftiD. or Multiprocessor architectures, are the most general paralel processors and are capable of executing 
muftfpto corttof threads in parafleL Tightly coupled (shared memory) MIMO computers era applicable when the problem 
requires a high degree of inte r pro ce ss communication and a high degree of sharing of objects/tesources in the system. 
These mechiries can supports tner degree of pmcess granularity due to me high inltrpto ce sscommurti ca tion ba ncKridm (on 
the order of memory bandwidth). If tha problem cals for minimal data/resource sharing, then loosely coupled 
mutfprooesaors are appticable and mi not be subject to performance degradation due to resource contention as is often 
me case in a shared memory system. 

5.1.3 Mgh Level Processing 

Typical functions performed at mis level are route and path planning by heuristic search such as A*, mission 
planning, logical inferendng. and object recognition and understandtog. This level operates on data that has been 
preprocessed by each of the lower levels and typicatiy controls the lower levels. It is characterized by: 1) Low bandwidth 
i/O rates: 2) Varied operations on afferent data types and irregular data structures; 3) Symbolic processing: 4) 
Heuristic search of a large number of alternatives. 

MMO machines are the most widely appfied architectures to this level of processing. This is due to the flexttity in 
these systems since afferent processors can be appied to different aspecte of the problem. Examples are paraM 
branch-andbound search and paralel execution of logic programs pj. 
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5.4 ParaM Programming 

The biggest chalenge facing me use of paraM processors tor supervisory control systems is the complexity of 
programmng many paraM machines. This cftfficufty arises because programmers must often famffarize themselves wtih 
tow level details about the paraM architecture as weti as paraM progr am ming techniques before they can become 
effective users of a paraM machine. In order to take advantage of the paraM hardware, conventional programs must 
often be r a mit ten and embedded wtih system cats tor memory and process atiocation. In addtion. Mon software is ported 
from one paraM machine to another, it must again be lewritien to account tor a afferent a r ch itect u re and set of paraM 
language features. ParaM p rogram m ing technology is maturing, and advances in me totiowing areas wte resut in more 
efficient programming: 


1) Opti m izing compilers for serial languages. Such compaeis w* atiow tor portabffty of existing codes to paraM 
machines by making the underlying paraM architecture transparent to the user. Furthermore, this wiff allow for 
portabtity of software across different paraM architectures. Progress in this area has been made tor both conventional 
languages such as C and Fortran [6] as wea as Ai languages such as functional languages and Prolog {9). We are axrertiy 
working on a paraM interpreter for Prolog execution on toe Butterfly which automaticafly optimizes toese program s lor 
paraM execution. 

2) A common set of paraM programming and language afastactfons which can be appied to toe wtous languages 
and ported across different paraM machines. This coupled witi optimizing compilers aflows tor the use of p a rt ial 
archftectjres at multiple levels of expertise. Novices can write progr ams which are automaticaly paraHefezed and 
optimized tor the particular architecture. As they become more experienced and knowledgeable about toe particular 
a r c h it ect ure being used, they can optimize programs even further by embedcflnp toese abseactions - or compfler directives 
* within toe* programs. 

3) A common set of resource sharing and process intercommunication protocols which w 41 atiow for programs or 
processes operating on heterogeneous processors in a network to communicate. 
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6.C0NCLU90N 

There am many open issues concern^ tie development of supervisory systems for Space Staton btftw key taor 

to tw man-machine fraarphy. System daeign maSwdotagiei mutt dtowlht humans who pa n— tie mejorky of toe 
inteflgence to use tie subsystems as toofc. The tubryrtwnt shoUtfwnptoy hu n wn c apafatttoe by dbwfogfie operate to 
dkectkoUbtoshoot end s tt a no s system pertownenceL F^s conceptual stBndpojntbotiliieiaicttctoaeooiitooseiofs and 
feedback bops see common to man arM machine fcarebyprovtfng a simple ftrameeroik tor interaction. Unloriunttdy. 
typical tosio are quite complex, requiring twt humans eokwtiem. As experience is gdned.te human operators** be ii 
the postoon to encode new procedures, prodded Ml toy have tie right development tools. 


ParaMimplemertatonof toese supervisory control systems wff provide the performance necessary to sustain 
ree l S me ex ecuton of such s yst e ms . I d ea B y. dtot rto utod computer systems co n sisti ng of serial, special purpose, and 
parsed processors waste* for optimal p erfor ma nc e ol tie dMersnt processing requirements of such systems. The 
major dkfcuty. h owe v e r , in using pafiiel aroftitsctes e ff e cti vely Is toe complexfty of p r o gra m ming them. Recant and 
tortcoming advances in paratel software technology wfl reduce tie impact of tits problem and alow for paraAal 
implemenlatfon of tiese systems. 
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